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The influence of expectations and hypothegeis testing 
on subjects’ use of particular types cf evidence to estimate 
cowariations was investigated. Results of the first study indicated 
that all subjects relied most on positive cenfirming evidence and did 


Not over-utilize evidence that was consistent with expectations. | 
‘Results of the second study indicated that subjects reported seeing 


more instances which confirmed than disccrfirmed their expectations, 
but subjects did not over-utilize th& estimated frequency cf 


. expectation-consistent instances in their qovariation judgments. 


Hypothesis-testing subjects relied most on the estisated frequency of 
hypothesis-confirming instances, while sutjects whe were not given a 


. hypothesis to test did not appear to tse any particular type of : 
evidence to estimate covariation. (Author)- . en 
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One of the tasks facing the social perceiver is. estimating the degree 
of co-occurrence of attributes and events in the social environment. ° In order 


to arrive at a reasonably accurate estimate of co-occurrence or correlation, 


ED 166628 


the social perceiver must collect data concerning the positive and negative 
(or high and low) instances of the ee bal use those data in a prescribed 


~ 


manner involving arithmetic calculations. While cbinating correlations would 
seem to be a time ccs! and ‘aietiout task,social Reccervars make cor- 
relation estimates pam a 480 variety of events. For example, everyone 

has an implicit personality’ theory about what traits correlate with each 
other (Hastorf ’ Schneider and Polefka, 1970), and everyone estimates the de- 
gree to — one's own behavior co-varies with one's outcomes, such ag the 
more I drink at night, the worse I feel in the morning. 

How does one 'geconcile the facts that judgments of covariation are "eee te 
common yet. so difficult? The difficulty of the numerous steps involved * : 
correctly estimating a correlation taken together with the ease with which 

F . ate aimee are provided suggest that the actual process by which 
piule judge correlations differs from the normative procedure that stat- 
/ | : isticians use to accurately estimate correlations (See Nisbett and Ross, in 
/ 4-4 
i press) - In fact, there is abundant evidence that people are particularly 


bad at estimating covariation. Several researchers have demonstrated that 
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‘people make systematic errors in assessing the degree of covariation be- 
tween two categories of events. eA errors, or erroneous inferences about 
covariation are called illusory correlations. For example, Chapman (1967) 
showed that people consistently overestimate the ‘degree of co-occurrence 
between two associated words, such as table and chair. | 
| What is the source of illusory correlations? we hypothesized that ‘ 
schemas might be responsible for their occurrence. A schema is an enduring 
theory about some stimulus domain that is organized through experiente: a 
schema provides a knowledge structure about the elements. ofa eniilus do- 
main and the relationships among those elements. For example, "salesmen - 
are extroverted” might be a very simple schema about salesmen. How might 
‘schenas lead to illusory cogrelations? Schemas contain information about . 
Ms, 


what Bigeeriee 9 of events are expected to co-occur. We sila schem- 


atic procésging: might lead people to “see”. those relationships which thete 
“So « 


on ; 
schemas lead them C0 ORCC : ae 


Much of the eepearch on assessment of covariation has arrad _ 


as demonstrating that people over-rely on the number of instances which: con=- 


firm whatever covariation they are asked to assess. For example, subjects. 
assessing the covariation between cloud-seeding and rain use the frequency of 
instances in Which cloud seeding was followed by rain, rather than using 
* Shake, instances plus the frequency of cloud-seeding-no rain, no cloud seeding- 


wei, “ana no cloud=seeding-no rain inetwiben, as an unbiased strategy would 


dictate. This “atraceay has ge a -been demonstrated in subjects assessing the if 


covariation between their own pahavdar ae outcomes (Jenkins and Ward, 1965) f 
and in nursing students assessing the: covariation. agg symptoms and diag= — i 
‘ ee, hag 


noses (Smedsiund, 1963). Each of these studies: that: demonstrate illusory 


ccreaiation: can be ‘interpreted as demonstrating that people. over rely. 6f 


s ; - 


. ; ’ the frequency of schema-consistent cases when they assess covariation. We all- 

i . § ae know. that arientiets have developed somewhat effective cloud-seeding a 

" mureing students should have well-developed schemas for symptoms covarying 
with diseases, hi the ‘illusioh of control iterative suggests that people 

- Og overestimate the likelihood that their sietnmeneal behavior will bring about 

z gp : | a desired outcome (Langer, 975) . Thus, each of these studies has asked sub- 


jects: to assess ica Tae ia that are consistent with their schemas. None 


of the previous vaveseek has looked at what subjects do when assessing a | 
schena-inconsistent covariation. ; b,x yf ~ 


We tested the hypothesis that peoess overestimate schema-consistent co- 


variations but nét ‘schema- inconsistent covariations by having subjects 
read oe a series of descriptions of people, and then estimate the 
v Ni 
degree 0 of covariation between two of ' their attributes - hair colo and 
, P. eye eine, ‘Before, xeading his descriptions aubsacte:s were instructed to See 
ros assess a schema-consistent or expected relationship (between blond hair and 


blue eyes) or a "schena~inconsis tnt ‘or ymenpacted xelabionabiy: between brown 


hair and plua even. we predicted ie both groups of subjects would use the : 


“—guumber « of schema’ consigtent descriptions, rather than the number of des- 
criptions which confirmed the ‘relationship they were instructed to assess, 
to estimate covariation. As a result, people should ze more likely. to 
"gee" an expected than ‘an imexpected civariacion in the ‘descriptiong. 
The data anatyeis provided no ‘support for our hypothesis. Both groups 
of subjects depended péieattiy on baa: frequency of cases ahteks confirmed the * 
covariation they were assessing, regardless’ of whether or not they were assess- 


x 
e 


In. 


ing a schema-consistent relationship. . 


er words, people assessing the 
“blond hair-blue eyes covariation used the frequency of thee biie instances 
as evidence, but pate assessing the — hair-blue eyes covariation used - 
, the frequency of brown-blue instances as evidence. 5 
Why did we find no support for our plostiees that schemas influence the 


4S 


evidence one brings to bear in assessing covariation? There are'a. couple of 
uninteresting explanations sas one interesting one. First, the uninteresting 
: ones: It. is possible that the descriptions we used: were not appropriate. 
bine: descriptions provided very ‘clear, unambiguous descriptions of hay : 
ice and eye olor,and it is possible: ‘that schemas influence ROVERLREION Judg~. re 
ments only ubdex conditions of waite ei Alternatively, the dssaribes onl may. fave: BS 
elicited a relatively om schema.’ “Haa we. tepped? a more powerful schema, our 
_ hypotheais might “have een confirmed. Neither of roe explanations was con- ve 
vincing to us, because the previous studies have demonstrated illusory correl- 


TN 


ne ations. under conditions of no ambiguity and ‘have. dvaivn upon, relatively un- 


important or weak, ahictiae: . > ’ a : ie i oa 3 
- The explanation we favor is. that when people are testing a hypothesis, 
SRY. hypothesis, they use “hypothests-coifizming evidences similar effects 
Rave been shone on an interactive task by Snyder and Swan (in prunes But , a - 
. if no hypothesis is provided, they will fail ‘back on their schema, ane use P a te 
schema-consistent evidence. In other words, when people are told what to look 


for, or are given a Bypethenis before they see the evidence, as they were in 


_ Our study, they ‘will look for confirming evidence. When they are-not told 


a to look for., eney will look for information ~ that fits their beliefs 


.) 


about the world and overutilize this. schieed-conmiatent evidence — 
judgments. , 

To, test our new hypothesis, that hypothesis-testers over-utilize’hypo- 
ee pera evidence, but that people who are not explicitly testing 
eS a hypothesis will fall back on schema-consistent evidence to estimate covar- 

“Seton, we conducted ‘a second study.” In te, study aap eets "assessed either 


a scheni-consistent ora achems-idcohetaesne covariation, and they: either knew 


Bors 


din advance or - aia not know in advance what covariation they would be assessing. 


r : ¢ A r 


we . * 
; \ “ 
‘ . 


‘ the actual level of covariation in the descriptions was varied within subjects. 
7 : Pa The descriptions dn the study gave the peicepiitnn and a personality, trait of 
an individual. For example, in one sae of descriptions the schema-consistent 
descriptions wie of extroverted salesmen, and the achema-inconsistent. Aeideegs 
tions were of introverted ses auuat. The remainder of. the descriptions were . 


‘ schema-irrelevant, as determined by pre-testing-- extroverted or introverted 

‘bankers, in this case. j " 

. , To aipnacine the design, subjects were instructed to assess the strength 
\ "of a schema-consistent or inconsistent relationship, either before or after & 
. Viewing the ‘descriptions. TheSe were the between-subjects factors. There 
were four levels of actual correlation in the stimuli; this was a within- 
subjects factor. ~~ ¥ ’ a 
After reading through the descriptions, subjects estimated thé degree of . 
covariation in the descriptions and jueinated how many. of each of the four | 
types’ of instances they had seen. For re for one set of stimuli sub- + 
jects estimated how many extroverted salesmen, introverted ne extroverted 
-bankers, and introverted bankers they had seen. We predicted that hypothesis : Y : 
testers, that is, those whjwcts who knew in advance what covariation they were’ %. 
- assessing, would rely on the number of hypothesis-confirming instances while a, 
subjects with no hypothesis ‘to test would fall back on their schemas.and use 
ch frequency of schema-consistent instances to assess the covariation. 

The results are clearest if we present them on a cell by cell basis. 
Pirst, consider subjects who were testing a schema-consistent covariation from 
the outset. Subjects'who knew in advance that they were écdennies a schema- 
consistent covariation thought the degree of covariation was high, thought 


there were more schema-consistent than schema-inconsistent descriptions, 


and used evidence which confirmed the hypothesis they tested. That is, they 


é 
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oe, 


ee ae st, a 


number of confirming instances as the basis for estima 


a 


er a ° ae . 2 ; aaa = : 
R : > . & ag N 
Sais * 2 ii F ‘ F f : Be 
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e 


used their estimated frequency of schema-consistent instances to assess co- 

cee . ; ; wee ® 22 

‘variation. 7” gos SPs _% wy 
In comparison, consider subjects who ateeuded 4 a schema~consistent covar> : aa a 


dation, but who were not told in jadvance what covariation they had to assess. 


These giajects thought the - case of covariation was. high, -and: thought: they’saw <3 
more Schena-consistent than re enya descriptions, ut they did not -~ |. 

/ 7 i age 
wiitee any particular type of evidence to estimate the covar ation. . .In other jee 


words, they behaved like: dubjacts who did know in advance 
/ 

aesessing a schema-consistent covariation, except they did /not use Sues estimated y 

éovaristion. 


Now consider si a who were assessing a sch 


eg" 


Subjects who knew at the outset that they were “assessing . a pchamn lnceibatect 


inconsistent “covariation. 


By se ‘ o * 


covariation thought the covariation was low, thought they saw more ca 


tent than schema- inconsistent “descriptions,but used | oatemnred frequency. of ere 


‘ 
ii ny 


hypothesis-confirming or schema~inconsistent descri idoua to estimate covariation. = 


ry Subjects ‘who assessed a schema-inconsisten covariation and were not. $ 
given a hypothesis in advance thought the’ dovariation was low, thought they saw 


“ * . 1 


more schema-consistent than schema-inconsistent i: stances, and”did not use any en, 


particular type of evidence to estimate the covariation.. . 
What does this tell ‘ia abot ‘the relationship between schemas, hypotheses, 

and the eidauanadt of covariation? First, schemas: subjects were see likely 

to see an expected than o unexpected covariation, and they bnaught they Ga more 


schema-consistent than schema-inconsistent descriptions. Second, what was the 


effect of knowing in advance what covariation was to be assessed? The effect of 


5 r N\ i 
- knowing what covariation to look for seems to be that people with a hypothesis 


search the data for hypothesis-confirming instances, whether that hypothesis fits 


a schema or not, and use the estimated frequency of hypothesis-confirming in- 


stances to estimate covariation. _People who do not have a hypothesis in advance do. 


i 


‘ * 


" way Pibvide a basis for interpreting ambiguous stimuli. A second reason that 


. Rot use any particular type of evidence when estimating covariation. ae 


of whether people set out to test a schema-consistént ora schema-inconsis+ 2 


_ their schemas. Why might sc s be highly pentane ad disconfirmation? One 


. 


- having a hypothesis in advance seems to enable People to select certain in- ' 
formation as important to a judgment, to search particulariy for that BVLIEHCR 

and use the results of the search to make a judgment. a ne : ee 
. ‘What aon we pence One of the main. findings of. this study is that . | 


“people are more likely to "see" schema-consistent or aay Covaxtattons° 


. than schusa-taraniatent or. unexpected covariations. This was true ‘regardless 


. ¥ 


tent a and begavdlena of whether there was actually a chee 
consistent or schema-inconsistent covariation in the descriptions. this Seni 
suggests to us that \ichemas. are highly sig ce a to disconfirmation.” "Phat is, 


pespia: do not seem.to use disconfirming eelsencé appropriately to modify 


_ 


explanation may be that schemas, ‘are, enduring beliefs. Eatee on experience, 


schemas abe weetakant to disconfirmation may be ‘that schemas provide "best 
i. f® s 
guesses" far filling in missing data and scan bedatt -of schema-consistent 


data. ‘These best. guesses would be based on experience and function like 


~ 7 
"default options" in a computer program, filling in reasonable values where 


data are missing (c.f . Minsky, 1975). The fact that subjects remembered more 


schema-consistent ‘than schema~inconsistent instances in he present study Fits 


either an interpretation of ambiguous stimuli” or a “best guesses - aid to 
call" explanation. | 

These data further suggest when new schemas will be acquired. New 
itionix will-be acquired when a hypothesis is tested and-an appropriate num- 
ber of confirmations of the hypothesis are found. The presence of disconfirm- 
ing evidence will be relatively ineffective in leading to a rejection of a 


schema-consistent hypothesis, however. These points suggest that it is easier to 


8 | a es | A - ie 


Pica _ acquire @ new schema than it is to reject an old one. . 
‘ \ . 


‘an - Finally, the present study cldars up a thorny problem in the literature 


\ 


fin a on the assessment of covariation. In that PURREATUES some studies have pointed R 
hile to gver=reliance on the Peaciency of confirming cases. ward and Jenkins’ (1965) 
Jenkins ee, Ward (1965) and Smedslund i 1963) provide examples \of these studies. 


Gites have reported that subjects -are insensitive to the frequency or. in- 


ms frequency of césikieniing cases, as in studies by the Chapmans (1967, 1969). A 

i. viel of these studies indicates that when subjects know in advance what 
covariation they will be assessing, they rely on the frequency of confirming 
_cases, as subjects in our study tho: were told in advance what relationship to 
assess. In those studies in which Subjects a not’ knot in advance.what co- 
variation they will be assessing, ab ecee ‘are relatively insensitive to the 


frequency of confirming cases, but report the ‘expected relationships, like the. 


‘seh = 


subjects in our study who were not given a hypothesis to test. 
* 7 : : —- 
In sum, the data you use is determined by what you are looking for, but 


what relationship you find is determined by your theories. . 


| amet 
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